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We discuss the response of aging systems with short-range interactions to a class of random 
perturbations. Although these systems are out of equilibrium, the limit value of the free energy 
at long times is equal to the equilibrium free energy. By exploiting this fact, we define a new 
order parameter function, and we relate it to the ratio between response and fluctuation, which 
is in principle measurable in an aging experiment. For a class of systems possessing stochastic 
stability, we show that this new order parameter function is intimately related to the static order 
parameter function, describing the distribution of overlaps between clustering states. The same 
method is applied to investigate the geometrical organization of pure states. We show that the 
ultrametric organization in the dynamics implies static ultrametricity, and we relate these properties 
to static separability, i.e., the property that the measure of the overlap between pure states is 
essentially unique. Our results, especially relevant for spin glasses, pave the way to an experimental 
determination of the order parameter function. 
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I. INTRODUCTION 

Ergodicity breaking in glassy systems is well understood within mean- field theory Q-Q]. In this context the de- 
scription of thermal equilibrium has several peculiar aspects. While in non-disordered systems it is usually possible 
to select pure phases via boundary conditions or suitable external fields, this is problematic in glassy systems, since 
one does not have in general the a priori knowledge of the low free-energy configurations. Consequently, the Gibbs 
measure for a large finite system will generically turn out to represent a mixed state. This phenomenon was first 
discovered and understood in the mean- field theory of spin glasses, and was named "replica symmetry breaking" 
(RSB) from the technique originally used to analyze these models. However it is not specific to disordered system, 
and recent theoretical studies have shown that it appears in first-principle computations of the vitrification of simple 
liquids ||. Numerical simulations unambiguously show that detailed predictions of the mean-field scenario apply to 
a number of finite dimensional systems || . An experimental verification of the most characteristic predictions of the 
theory in real materials is however still missing. The main difficulty lies in the fact that it appears impossible to 
measure directly the basic quantities involved in the theory. One of the most important predictions of the theory is 
the existence of infinitely many pure states, which depend stochastically on the realization of the quenched disorder 
M — if present — and on system size In this situation one is forced to adopt a probabilistic description of the 

Gibbs measure, and to study the statisticalproperties of pure states. A first fundamental characterization is given 
by the "overlap probability function" P{q) ||, which is the probability distribution function of the codistance among 
equilibrium states, averaged over the disorder and/or the system size. However, its direct measurement is opposed 
by two basic difficulties. First, it would require a detailed knowledge of the microscopic configurations of the system. 
Second, glassy systems are never at equilibrium on experimental time scales. In this paper, we show that linear 
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response theory allows to define a new function P(q) in terms of a set of responses to some appropriate perturbations 
in the Hamiltonian (i.e., generalized susceptibilities), and to relate them in turn to some dynamical functions which 
can be experimentally measured. We then argue that, for a large class of systems, P(q) is directly related to the 
equilibrium order parameter function P(q). These systems, which we shall call "stochastically stable", are such that 
their "metastate" (i.e., the probability distribution of the pure states) is stable under some random local perturbations 
of the Hamiltonian. 

Linear response theory, i.e., the study of the effects of small perturbations on physical systems, has a long history 
in statistical physics. One of its fundamental results is the fluctuation-dissipation theorem (FDT), which establishes, 
under the hypothesis of thermal equilibrium, the equality of two quantities of a priori very different nature: the 
response to a small disturbance and the correlation function describing the statistical fluctuation of the disturbed 
variables. The theorem is of course of fundamental importance: in equilibrium conditions one can get information 
about the fluctuations of the system just by studying its response to a perturbation. This relation, however, has no 
reason to hold in general off-equilibrium situations, where the response and the correlation functions are unrelated. In 
recent works, in fact, several mean-field models of spin glasses and glasses have been studied, in which the asymptotic 
violation of time-translation invariance appears together with the violation of the equilibrium relation between response 
and fluctuations. Slow, history-dependent dynamics, usually referred to as aging, is a constitutive property of glassy 
systems ||. It has been observed in a number of experimental systems, which go from polymeric glasses to charge- 
density waves, and in the numerical simulations of practically all the glassy systems where it has been searched. We 
shall mostly refer in this paper to spin glasses as the prototypes of aging systems |10 although our considerations can 
be applied to any glassy system. We notice in particular that one could discuss in a similar way some systems which 
are slightly out of equilibrium due to the presence of a slowly time-dependent Hamiltonian or small non-conservative 
forces 0,Q, but we shall not develop this discussion here. 

In a typical aging experiment one monitors the relaxation of a spin glass at low temperature, after a quench from 
the high-temperature phase at an initial time. One of the most striking features of aging dynamics is that even for 
the longest observation times the system does not reach a stationary state. One can concentrate on two classes of 
observables: "one-time observables" , that depend on the configuration of the system at a single time, and "two-time 
observables" , like correlation and response functions, that depend on two times. Due to the relaxational nature of 
the dynamics, one-time observables tend to time-independent limits. The off-equilibrium nature of the dynamics 
is manifest in the behavior of some two-time observables, where one sees that time-translation invariance is never 
achieved, and that there is always a residual dependence on the age of the system. 

Our starting point will be the observation that, even in the presence of aging, in short-range systems with non- 
singular interactions, the long-time limit of the energy density must coincide with its equilibrium average. We then 
explore the consequences of linear response theory supposing equilibration of the energy density, but not necessarily 
full thermal equilibrium. Using some special random local perturbations of the original Hamiltonian, we identify a set 
of susceptibilities which are endowed with very useful properties. When evaluated at equilibrium, these susceptibilities 
define the moments of an order parameter function P(q) which is self-averaging. On the other hand, in the dynamical 
framework, one can show that their dynamic expectation values converge at large times to their static one, establishing 
the bridge between aging and static ergodicity breaking. We will then establish, for stochastically stable systems, the 
identity of the fluctuation dissipation ratio (FDR), which expresses the asymptotic violation of FDT, with the overlap 
probability function that describes the statistics of distances among pure states in the equilibrium measure. This 
result is very general, since it holds in any system with short-range interactions. (In long-range models, or in models 
with singular interactions, the convergence of the energy density to equilibrium is not guaranteed and the theorem 
does not necessarily apply.) For equilibrium systems it reduces to the usual relations connecting static and dynamic 
susceptibilities, which are consequences of the FDT. It is more interesting in the case of glassy systems, where new 
consequences can be derived. 

Similar arguments can be developed in order to study other aspects of ergodicity breaking. Particularly interesting 
is the geometrical organization of equilibrium states in phase space, for which mean-field theory predicts ultrametric- 
ity. This property has a dynamical analog in the ultrametric relation among (two-time) correlation functions for 
three different long times. Indeed, ultrametricity appears rather naturally in the dynamics within the "weak ergod- 
icity breaking" scenario. We shall show that if ultrametricity holds in dynamics, then stochastic stability implies 
ultrametricity for the equilibrium system. 

A first partial account of our results has appeared in ref. [ |T3[ . 

The paper is organized as follows: In the next section we recall some basic facts about the out of equilibrium 
dynamics and aging. Sect. 111 introduces the overlap probability function and reviews some of the main equilibrium 
properties. Sect. IV introduces the set of random local perturbations of the Hamiltonian which are used in order to 
define the new order parameter function P(q), and its dynamic counterpart. We then develop, in sect. |v|, the notion 
of stochastic stability, and show the close link which exists between the functions P(q) and P(q) in stochastically 
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stable systems. Sect. VI establishes th e ult rametricity property of these systems, firstly in a dynamical framework, 
and consequently in the statics. Sect. VII contains some discussion and summary of the results. Two appendices 
explain some technical details of the computations. 



II. OFF-EQUILIBRIUM DYNAMICS 

We use for definiteness the language of magnetic systems, considering classical spins S x on a <i-dimensional lattice 
of size N = L d . The spins are real variables in a double-well potential, and we often implicitly take the Ising limit. We 
do not need to specify much of the interactions, but we assume that they are expressed by a short-range Hamiltonian 

We suppose for simplicity that the dynamical evolution of the system of N spins is given by the Langevin equation 

where a; is a discrete index that labels the spins and r] x is a white noise of variance (r]x(t)Vy(t')} = 2TS xy S(t — t'). We 
use here the same notation, namely the angular brackets, to denote both the average over the thermal noise in the 
dynamic context, and the Gibbs average in the static context. Which one is meant should be clear from the context. 
The use of the Langevin dynamics is not crucial for the statements we shall make below, since they are essentially 
based on linear response theory. We show in appendix [X] how our arguments can be generalized to any system with 
dissipative dynamics (e.g., Glauber or Metropolis), where the spins are locally updated according to the value of the 
instantaneous molecular field. 

We denote by S the microscopic configuration of the system: S = {S x }. We make use in the following of the 
Martin-Siggia-Rose representation of the Langevin dynamics, in which the thermal averages of the observables O are 
expressed by functional integrals: 

(0(t)) = J V(S) V(S) e /[s ^O[S(t)], (2) 

with the dynamical action 

I[S,iS] = J dt' ^iS x (t') 



4 + |^ + iTS x 
dS x 



(3) 



When inserted in a correlation function, the auxiliary field iS x (t) acts as the functional derivative with respect to a 
magnetic field at site x and time t. 

We suppose that the system has been quenched at time t = from a very high temperature into its spin glass phase. 
It then evolves at a fixed temperature T, starting from a random initial configuration. The fact that the system is off 
equilibrium appears at long times in the "two time observables", i.e., in the correlation and response functions. We 
focus on the spin-spin autocorrelation function C(t, t') = (1/N) J2x(^x(t)S x (t')), and on the associated response of the 
spins at time t to an instantaneous field at time t': R(t,t') = (l/N)J2 x S{S x (t))/Sh x (t') = 0-/N)Y, x (S x (t)iS x (f)). 
In our notations it is understood that the first time argument is always larger then the second one. A quantity 
which is of particular experimental interest is the relaxation function, which is proportional to the integrated response 
function^] 

X (t,t')=T [ dt" R(t,t"). (4) 



In the linear response regime this function measures the adimensional magnetization, deriving from a uniform field 
acting from time t' to time t. We suppose in the following that the contributions due to the response of a spin to the 
field in different sites sum up to zero, otherwise our definitions must be adapted to take into account this contribution. 

We are interested in the behavior of these quantities in the double long-time limit t, t' — > oo, always taken after 
the thermodynamic limit N — > oo. The phenomenon of aging is associated with different behaviors, depending on 



1 The definition of x adopted here differs by a factor T from the most common one. 
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the path along which the two times are sent to infinity [M. A first regime is obtained when the long-time limit is 
taken keeping the difference r = t — t' finite. In this regime, the correlation function C(t,t') becomes a function of 
t: c(t). The quantity qea = lim,--^ c(r) is known as the Edwards- Anderson order parameter in spin-glass theory. 
In systems which have only one equilibrium phase and consequently reach equilibrium very fast, the only non-trivial 
long-time regime corresponds to this limit, and one can measure qea by taking the long-time limit of C(t,t') in any 
order, provided t — t' — > oo. 

On the other hand, in systems exhibiting aging there are other interesting dynamical regimes, where the correlation 
relaxes below <7ea, and spans the whole interval [0, 9ea], depending on how the infinite-time limit is taken.^j This 
phenomenon has received the name of "weak ergodicity breaking" |l5| . It can be generically expected whenever 
there are different phases in competition. For example, it is found in the domain-growth dynamics of ferromagnets, 
or more generally in spinodal decomposition. In these cases, if the initial conditions do not favor one phase with 
respect to the others, one finds for long times C{t,t') w c* (L(f) / L{t)) , while x(M') ~ Xoo + L(t)- a x*(L(t')/L(t)) 
Jl6],[l7|]. This dependence can be understood on the basis of dynamical scaling. After a short transient the system 
enters an asymptotic regime where the growing domains of the different phases are characterized by a typical length 
L(t). Scale invariance implies for the correlations C(t,t') w C* (L(t')/L(t)). The factor L(t)~ a (a is equal to 1 in the 
simplest cases) appearing in \ is due to the fact that only the spins at the boundaries between different domains give 
a contribution to the long-time response. In pure ferromagnets one has L(t) ~ t 1 / 2 for non-conserved order parameter 
dynamics and L(t) ~ t 1 / 3, for conserved dynamics. For domain growth in the presence of some pinning disorder, the 
growth of L{t) will be slower, but the general behavior should be the same as in pure ferromagnets, with a response 
function which is much smaller than the correlation at large times. 

The case of glassy systems, where aging seems to have a very different nature than in domain-growth processes, 
is more interesting. It is important, in the following discussion, to consider aging in the linear response function 
x(t, t'). Mean-field theory predicts that, asymptotically, C and \ should depend on the same function oft and t', and 
therefore, that \(t,t') ~ x(C(t,t')). Such a behavior cannot take place in domain growth kinetics (nor in a droplet 
description of aging), in which only the spins at the border of the growing domains contribute to the response. In 
order to characterize the relation among correlation and response one can define the function 

*<«> js. ■ «*.o/^. 

C(t,t') = <J C(t,t')=q 

which is called the fluctuation-dissipation ratio, and depends a priori on the value q of the correlation which is kept 
fixed while one sends the two times t, t' to infinity. 

In the finite r regime, in which q G [<7ea> 1], local equilibrium implies X(q) = 1, which is the expression of the usual 
fluctuation-dissipation theorem. But a non-trivial behavior is possible for q £ [0,<jea]- Mean-field theory predicts 
that the function dX/dq is non trivial, and satisfies the properties of a probability distribution. Simulations have 
shown that this fact also holds in 3D and 4D spin glasses iQ. The function X(q) is experimentally accessible through 
waiting-time monitored measurements of the thermoremanent magnetization and of the noise. Its measurement will 
allow one to distinguish whether the glassy behavior is a slow domain growth, where X{q) — 6{q — <7ea)j or whether 
it has a more complicated behavior, with X(q) ^ at q < gEA, as seen in mean field and in simulations. 



III. EQUILIBRIUM 

For short-range Hamiltonians with non singular interactions, classical arguments, based on neglecting surface with 
respect to volume terms, show that the averages of the free energy density have a thermodynamic limit. Intensive 
quantities, which can be obtained as derivatives of the free energy densities are unique and self averaging except, in 
case, at first order phase transitions points, where more than one phase is present. We are interested in situations 
of broken ergodicity, where the infinite-volume equilibrium measure is not unique. Sometimes, when one knows a 
priori the set of equilibrium states, one can select one element of the set of the equilibrium measures or another by 
properly choosing the boundary conditions or some small external field. In ordered systems this allows to select pure 
phases, or ergodic components, which correspond to physical equilibrium states. Unfortunately, this procedure is of 
no use in the case of glassy systems, where our lack of knowledge on the structure of the low lying states prevents us 



2 Cases in which the correlation does not decay to zero, but to a minimum value qo < <?ea are also possible. For simplicity, we 
always consider in this paper go = 0. Considering the generic case would just make notations heavier. 
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from picking up the correct boundary conditions necessary to project on the pure phases. Indeed, pure phases have 
identical values of the densities of extensive quantities like internal energy, magnetization etc. 

If the boundary conditions are uncorrelated with the energy landscape (e.g., periodic) the Gibbs measure turns out 
to be a mixed measure. In addition the measures can have a strong dependence on the quenched disorder and/or on 
the system size. Under these conditions it is useful to study the statistical properties of the mixtures and to perform 
the analysis at very large, but finite N, avoiding the discussion of pure states for an actually infinite system. An order 
parameter function which shows up naturally in mean field is the overlap probability function. It is defined by picking 
up two microscopic configurations S and S' at random, with the Gibbs measure, and measuring the histogram P(q) 
of their overlap Q(S, S') = (1/N) J2 X S X S' X . More precisely the order parameter function, P(q), is given by 



P(q) = lim E , 

N-*oo 



i Y, exp(-/?(#(S) + H(S'))) S (Q(S, S') - q) 



S.S' 



(6) 



We have denoted by Ej the average over the quenched disorder in the system (if present) or over a window in N, 
increasing with N, and by Z the partition function. In ergodic systems, P(q) is given by a single delta function, 
whereas it can have a nontrivial structure in systems with ergodicity breaking. This appears explicitly in several 
mean-field models. Present numerical simulations give evidence in favor of ergodicity breaking and of a non-trivial 
P{q) in finite-dimensional spin-glass models 0], but the relevance of this result has been challenged JTsfl . The theorem 
we are going to discuss relates the function P(q), which is not directly accessible in experiments, to the fluctuation 
dissipation ratio X(q), which is measurable. It thus clarifies the relevance of the function P(q) defined by eq. (0) and 
opens the way to obtain some experimental evidence concerning its behavior. 
In the next section we shall need to compute some correlation functions like 



Cp — Ej [(S Xl ■ ■ ■ S Xp ) 2 ] — Ej 



i Y exp(-/3(ff(S) + H(S')) S X1 S' X1 ■ • • S Xp S' x , 



S.S' 



(7) 



for very far apart sites Xi, ■ . ■ , x p , in the presence of some quenched random variables J. The relation of these moments 
with physically clustering states and its expression in terms of the function P(q) is discussed in We just give here 
the result: 



C P = Jdq P(q) <f. 



(8) 



IV. PERTURBING THE HAMILTONIAN: A NEW ORDER PARAMETER FUNCTION 

In this section we shall define a new equilibrium order parameter function P(q), and the corresponding fluctuation- 
dissipation ratio X(q). The derivation of their properties involves the study of the linear response to some special sets 
of perturbations of the original Hamiltonian. This method has been recently used to derive interesting properties of 
the overlap distribution at equilibrium |l9| , |20| . We start by recalling some well-known perturbations which are long 
ranged, and whose expectation values yield the moments of the function P(q) in statics and of dX/dq in dynamics. 
However, the long-range nature of the perturbation forbids one to establish the relationship between the long time 
dynamics and the statics. We shall thus introduce a new set of perturbations which are purely local, and from which 
the result can be derived. 

It is known that the moments of P(q) and dX/dq are respectively related to the canonical jl9| and the dynamical 
averages |2l[] of long-range perturbations to the Hamiltonian of the form 

1,N 

Hp R (S) = Y Jh,...,ip S il ■ ■ ' Sip' ( 9 ) 

where the couplings Ji lt ....i p are independent Gaussian variables with zero mean and variance Sj(J? t i ) = 
p\/(2N p ~ v ). Now, one can easily see that the canonical average of -ffp R with a perturbed Hamiltonian given by 

H t = H Q + eH™, (10) 
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verifies, for all values of e, 



Ej(H^) = -0eN \1- J dq P e (q) <f j , (11) 

irrespective of the specific form of Hq. Here the function P e (q) is the order parameter function @, in the presence of 
the perturbing term in the Hamiltonian. The derivation, reported in appendix [A], involves an integration by parts in 
a finite system, followed by the infinite- volume limit. 
On the other hand, in off-equilibrium dynamics, one has 

hm Ej(H™(t)) = -N(3e (l - J ' dq <?) , (12) 

where X e (q) is the FDR in the presence of the perturbation (we recall that the system has been quenched at time 
zero). For completeness, formulae (|Tl| ) and ( [l2|) are derived in appendix |X| 

These identities suggest that one could have P(q) — dX/dq. However, in order to derive this result one needs 
two more steps which are far from trivial. First, one should prove that is statically self-averaging and that its 
dynamic expectation value tends to the equilibrium one. Second, one must discuss the continuity of the functions at 
e = 0. Concerning the first point, our main concern is that the long-range perturbation could give rise to infinitely 
long-lived metastable states in the system, so that lim t _ (00 (_ffp R (i))d yn 7^ (H p R ) s t a t- Although we feel that this is not 
likely to happen, in most systems, for small enough e, we do not know at present how to prove this fact. Below we 
use local (short-range) perturbations which get around this problem, and in the next section we address the issue of 
continuity at small e. 

The strategy we follow amounts to modify the definition of the perturbations, introducing a new H p which is an 
extensive sum of some local observables. Then the whole Hamiltonian Ho + eH p is short range, and thus self-averaging, 
and the long-time equilibration of the dynamical expectation (H p (t)) towards its equilibrium value can be shown as 
follows. One starts by proving that the free energy equilibrates. The classical proof of this fact is based on nucleation 
arguments. One first notices that the time-dependent free-energy density must reach, for long times, the equilibrium 
value f eq . All metastable states with a higher free-energy density /* can be destabilized by the nucleation of a 
bubble of radius r with a free energy cost equal or lower than cr d_1 + (/ eq — f*)r d . Therefore the free energy density 
reaches its equilibrium value. Since the static perturbation energy (H p ) is the derivative of f3F with respect to e, the 
equilibration of the free energy also implies the equilibration of (.Hp(i)).0 This differentiation will be allowed at small 
e provided the free energy is regular enough at small e, which is the issue which we shall discuss in the next section. 

The local perturbing Hamiltonian can be chosen in several ways, we present here the one we already considered in 
jyl . Let us consider a set of operators which translate the lattice along a direction i parallel to one of the coordinate 
axes: 

T^ p) (x) = x + —i; fc=l,...,p-l. (13) 

We denote by Si the set in which the coordinate in the direction i takes the values 1, 2, . . . , L/p. The new perturbations 
will have the form 

H P (S) = 4 p) S x S TlP){x) ■ ■ ■ S T M (xy (14) 

where the couplings J x are independent, identically distributed Gaussian variables, with zero mean and variance 
EjJ% — P- At first sight, also these perturbations seem to contain long-range interactions. However, they can be 
viewed as short-range observables in a different space. This is more easily illustrated for p = 2, but the generalization 

to arbitrary p is immediate. For p = 2 we can divide the space into two halves (Si and <S r ) and rename the spins in the 

(2) 

right-hand half so that if x £ Si then T(x) € S r and St( x ) — S x ( we wrote T{x) for 7f (x)). The total Hamiltonian 
can now be written as 



3 Generically, one should qualify this statement at first-order phase transition points, where the perturbation can select a 
given phase. However, as previously noticed, we are interested in a situation in which all pure phases have the same values of 
extensive observables, and this does not happen. 
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H(S,S') = H^S) + H r (S') + B(S,S') + eJ2 4 2) S X S' X . 



(15) 



x£Si 



The Hamiltonians Hi and H r refer respectively to the spins in Si and S r - The term B(S, S') is a surface term whose 
presence does not affect the average of H 2 . Dropping it, the Hamiltonian (15) characterizes a spin system of size L d /2, 
with two spins S x , S' x on each site, and a purely local interaction. The static expectation value of the perturbation 
(H2), gives therefore a contribution to the internal energy of the system which is extensive and self-averaging, i.e., 
independent (in the thermodynamical limit) of the particular realization of the disorder contained in either H or H 2 . 
Its long-time limit in off-equilibrium dynamics must yield its canonical value. 

We now take advantage of the self-averaging property of H 2 to express its static and dynamic values as functions 
of P(q) and X(q) respectively. Let us first discuss the statics: 



{H 2 } = Ej (H 2 ) 



Ej 



J 2?(S) cxp(-[3(H(S)+eH 2 (S)))J24 2) S x S T{x) 



(2) 

Integrating by parts over the random couplings J x we find 

(H 2 )=/3eN(l-Ej(S x S nx) ) 2 ). 
In the linear response regime we can write 

Ej(S x S nx) ) 2 = Ej(S x S y } 2 + 0(e), 



(16) 



(17) 



(18) 



where x and y are far away sites not directly coupled in the Hamiltonian, and consequently, according to the discussion 
of the previous section, 

(19) 



(H a )=0eN\l- J dqP e {q)q 

where the function P e (q) is the average overlap probability function of the perturbed system. Let us remark that 
in order to derive ( |l9| ) we need to integrate over the couplings J x 2 ^ ■ In the case where also Hq contains quenched 
disorder we can choose to integrate over it or not, but the result should be independent of this operation. This tells us 
that the order parameter function, averaged over the couplings in H 2 , is self-averaging with respect to the quenched 
variables in H , even for infinitesimal e. 

Similar considerations hold in the case of the dynamics. The self-averaging property of H 2 in the dynamics allows 
us to write 



(H 2 (t)) = Ej (H 2 (t)) 

= Ej [ V(S)V(S) e^^^S^Sr^it). 



(20) 



(2) 

Integrating by parts over the J x s, and observing that the insertion of iS x (t') acts as the derivative with respect to 
an impulsive magnetic field at site x and at time t' (iS x (t r ) \ — ► S/5h x (t')) we obtain 



Ej (H 2 (t)) - 2eY,Ej \ [ dt' - 6 (S x (t)S x (t')S T{x) (t)) 



(21) 



In the linear response regime, /3e <C 1, the average of the product on far-away sites factorizes up to terms of order e, 
and one has 



Ej 



Sh T ( x ) (*') 



r As x (t)s x (t')s nx) (t)) 



= C(t,t')R{t,t') + 0(e). 



(22) 



Assuming that the bound holds uniformly in time and substituting the definition (^) of the FDR, we obtain, for large 
values of t, 



2e/37V^ dqX £ (q)q = ePN(l- J dq^qA, 



(23) 
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where we have used C(t,t) = 1, and lim^oo C(t, 0) = (see footnote 2). We have denoted by X e the FDR of the 
system with the perturbed Hamiltonian H e . Comparing the two results, ( p^ ) for the dynamics and ( |l9|) for the statics, 
we see that the second moments of the dynamical order parameter function dX c (q)/dq and of the static one P e (q) 
coincide for the system in the presence of the perturbation ei?2- It is straightforward to generalize this derivation to 
arbitrary p (for p = 1 the perturbation is nothing but a small random field term), which shows that the p-th moments 
of the two functions dX e (q) / dq and P e (q) coincide for small e. Therefore the two functions coincide, and their limits 
for e — > 0, dX{q)/dq and P(q) respectively, also coincide. We have thus found one "new" order parameter function 
which describes both the static equilibrium situation and the out of equilibrium aging dynamics. In the next section 
we will see to what extent one can relate these functions to the FDR and order parameter function of the unperturbed 
system. 

Finally let us point out that the choice of the perturbation is by no means unique. In principle we could also couple 
different systems instead of translated copies of the same systems. This would amount to introducing p different 
systems and using as as perturbation 

# p (S)=£jW<?^- ••<?£, (24) 

X 

where the unperturbed Hamiltonian is given by the sum of Hamiltonians of the p uncoupled system. This approach is 
also viable and yields the same results as the one discussed above. Another possibility is to consider just one system 
with perturbing interactions with a finite range (Kac potential type), to be sent to infinity after the thermodynamic 
limit. 

Let us conclude by noticing en passant that we can use the short-range perturbations (^) to repeat the derivation 
by Ghirlanda and Guerra p2| | of the identities for the probability function of two overlaps at equilibrium, avoiding also 
in this case problems related with the proof of self-averaging and continuity of the correlation functions for long-range 
perturbations. 

V. STOCHASTIC STABILITY 

We have seen in the last section that the static and dynamic order parameter distribution functions, respectively 
P e (q) and dX e /dq, are equal in the presence of the perturbation, and that therefore their e — » limits, P(q) and dX /dq, 
coincide. We now address the question of the relation between these quantities and the conventional order parameter 
functions P(q) and dX/dq, i.e., the order parameter function and FDR defined in the absence of the perturbation. 
If we were to apply naive perturbation theory, we would directly conclude that they are equal. However, while this 
conclusion is inescapable for ergodic systems, it needs to be qualified in the more interesting case in which many 
crgodic components are present. 

Let us start with the statics. The problem is to understand what is the "equilibrium" state in the presence of 
the perturbation eH p , and how it is related to the equilibrium state at e = 0. Some problems can arise whenever 
the equilibrium expectation value of H p is not the same for all pure phases of the unperturbed systems. Then the 
limit value of H p as e — > will be the one corresponding to the favored phases. A simple example is the Ising model 
in the ferromagnetic phase with free boundary conditions, to which one adds a negative magnetic field term as a 
perturbation. Then in the vanishing field limit, the long-time limit of the perturbation is evaluated in the state with 
negative spontaneous magnetization, while the unperturbed measure corresponds to a mixture of the positive and 
negative magnetization pure states. Clearly in this case P(q) ^ P(q)- These two functions will also differ if the 
perturbation, instead of being a uniform field, is a random field. 

Indeed, the stochastic perturbations that we have considered will in general reshuffle the weights of the different 
ergodic components in the Gibbs measure, or even change their nature, and this changes the P(q) function to 
a different one (P(q)). However our perturbations are random perturbations which are not correlated with the 
original Hamiltonian. So they should change the free energies of the various pure states of the original systems by 
random amounts. Usually in glassy systems the distribution of these free energies is stable under independent random 
increments, as has been shown in mean field (in fact this property lies at the heart of the cavity method Q]). If this is 
the case then the two functions P{q) and P(q) will coincide. A noticeable exception to this result is the case where the 
original Hamiltonian has an exact symmetry, which is lifted by the perturbation. The simplest case is that of a spin 
glass with a Hamiltonian invariant under spin inversion. In this case P(q) = P(—q), since each pure state appears 
with the same weight as its opposite in the unperturbed Gibbs measure. On the other hand, if we consider H p with 
odd p, this symmetry is lifted. This means that in the e — > limit only half of the states are kept. If the reshuffling 
of their free energies is indeed random, then we shall have P(q) — 29(q)P(q) = P(q). The same type of reasoning 
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applies whenever the overlap q transforms according to a representation of the symmetry group of the unperturbed 
Hamiltonian Hq. 

Let us now discuss the case of dynamics. It is clear that the finite-time response and correlation functions involved 
in the definition of the FDR are continuous functions of e for e — > 0. If this limit is uniform in time, so that the 
infinite time and the e — > limits commute, one has X{q) = X(q). On the other hand, it may be the case that the 
linear response regime shrinks to zero as the time goes to infinity. This possibility shows up in the situation, in which 
the perturbations favor one (or more phases) phase. However we stick here to random perturbations such that the 
expectations of H p vanishes at e = 0. In this case it is reasonable to assume that the linear response regime survives 
at very long times, implying that X(q) = X(q). Let us stress that the existence of a linear response regime uniform 
in time is implicitly assumed in experiments attempting to measure X(q) in real systems, and is anyway a question 
susceptible of experimental investigation. 

Once the effect of exact symmetries is taken into account, one may expect that, for a large class of systems, the 
limit function P(q) in the limit of small perturbations tends to the order parameter function P(q) of the pure system 
where the exact symmetries are lifted, what is nothing but a statement of continuity of the correlations at small e. 
We call this continuity property of the correlations stochastic stability. Ordinary systems with symmetry breaking 
and mean-field spin glasses are examples of stochastically stable systems. In symmetry breaking systems (and in 
crgodic systems), the equality of P and P is immediate, since both functions consist in a single delta function. Thus, 
the problem of deriving the equality between P and P, appears only when the coexisting phases are unrelated by 
symmetry. 

Unfortunately, we are not able to characterize the class of stochastically stable systems in general. In particular, we 
do not know for sure whether short-range spin glass, for which our theorem is most interesting, belong to this class. 
However, stochastic stability has been established rigorously in mean field problems |ll|^0|], and numerically exhibited 
in three and four dimensional spin glasses, where also the equality between P(q) and dX jdq has been confirmed p3[ . 

Stochastic stability is a very powerful property, and it is the ingredient which allows to relate the properties of the 
low lying configurations, which dominate the Gibbs measure, to those of the configurations much higher in energy 
which are seen in the dynamics. This is most easily explained in the usual framework of replica-symmetry breaking, 
considering an approximation with only two possible values of the overlap, qo — among different states and q\ among 
the same state (i.e., one-step replica-symmetry breaking). The probability of finding a state with total free energy 
F a = F is given by p(F — Fq), where Fq is the equilibrium free energy. The weight of each state is given by 

w a oc exp(— f3F a ). (25) 

In one-step replica-symmetry breaking, the states which contribute to the Gibbs measure have nearly degenerate free 
energies. The non-extensive fluctuation of their free energies, corresponding to the low F regime of p(F), is given by 

nil 

p(F) oc exp(^mF), (26) 

and the function P(q) is given by 

P(q) = md(q - q Q ) + (1 - m)S(q - gi ) . (27) 

In its dynamical evolution from a random initial state, the total energy of a configuration at time t decreases as 

E = E oc + cNt~ x , (28) 

where A is an appropriate exponent. Correspondingly the difference between the total free energy at time t and the 
equilibrium value will be always of order N, with a prefactor going to zero when t goes to infinity. One can physically 
argue that the dynamics only probes the behavior of the function p{F) at large argument, and should not be related 
to the statics. Stochastic stability solves this apparent paradox, because it forces the function p{F) to be of the 
form (p6|), not only when F — Fq is finite, but also in the range where F — Fq is extensive but small (say of order 
eN). Indeed it imposes that the form of the function p(F) remains unchanged (apart from a possible shift in Fq) 
when one adds a small random perturbation. Consider the effect of a perturbation of strength e on the free energy 
of a state, say a. The unperturbed value of the free energy is denoted by F a . The new value of the free energy G a 
is given by G a = F a + er a where r a are identically distributed uncorrelated random numbers. Stochastic stability 
implies that the distribution p{G) is the same as p{F). Expanding to second order in e we see that this implies 
dp/dF oc d 2 p/dF 2 , whose only physical solution (apart the trivial one p(F) — 0, which corresponds to non-glassy 
systems) is given by eq. (^6j). The same conclusion could be obtained using the methods of reference |26[| computing 
the sample-to-sample fluctuations of the function Pj(q) 7 which in this case, where ultrametricity is trivially satisfied, 
are completely determined by the knowledge of of the function P(q). We see that stochastic stability fixes the form 
of the function p and therefore connects in an inextricable way the low and the high free energy part of the function 
p, avoiding a possible paradox. 







VI. ULTRAMETRICITY AND SEPARABILITY 



A very interesting aspect of mean- field spin glasses at equilibrium is the hierarchical organization of the pure phases, 
which build an ultrametric space. Indeed, in these models, the probability distribution of three overlaps 

^ (3) (<Zi2,<Zi3,<Z 23 )=£/^ eM-P(H(S)+H(S') + H(S"))) 

S,S',S" 

x 5{Q(S, S') - qi 2 )5(Q(S, S") - q 13 ) 5(Q(S', S") - q 23 ), (29) 
has been shown to vanish unless its arguments verify the ultrametric inequality 

q u > min{gi 3 ,g 2 3}- (30) 

It would be extremely interesting to measure the function P^(qi2,qi3,q23) in real materials. However, it is clear 
that a direct measure is impossible for the same fundamental reasons as the direct measure of P(q) is impossible: 
impossibility to reach equilibrium, impossibility to access the microscopic structure of the pure phases. 

In the following we first review the dynamical analog of the ultrametric identity. We then provide some arguments 
in favor of a link between the dynamic ultrametricity and the ultrametricity in the static organization of pure phases, 
as well as some arguments which indicate that dynamical ultrametricity could be a generic property of stochastically 
stable systems. The arguments are of the same nature as the ones used in the previous section, in that they rely 
on the study of systems weakly perturbed by some appropriately chosen random couplings. We need to introduce 
additional assumptions, which make the conclusion more conjectural. 

In glassy dynamics, weak ergodicity breaking scenario implies more than just the decay of the autocorrelation at 
long times. In particular, it implies a relation among the three different two-time correlation functions that can 
be built from the configurations of the systems at three different (long) times i m i n , ^int, ^max, namely C(i; n t, i m in)> 
C(i ma x, t min ), C(t max ,t int ). Exploiting the monotonicity of C in both time arguments one can, for each t[ nt , invert 
the relation between C(ti nt ,t min ) and t min and the one between C(t max ,t int ) and i max - In this way, for each t int , 
C(t maK , t min ) can be expressed as a function of C(t hlt , t mi „) and C(i max , t hlt ), yielding Q 

maxi ^min) /tint V^V^int) ^min); ^(^maxj ^int)) • (31) 

In the long-time limit, keeping fixed q 12 = C(t int ,t min ) and q 23 = C(t max , i int ), the function f^ t (qi 2 , 923) tends to a 
limit function /((/12, 923)- The properties of this function have been studied in great detail in j27). The "fixed points" 
of /, defined as the values of q for which q — f(q, q) are especially relevant. Indeed, if q and q' are fixed points, 
then / verifies the ultrametric relation f(q,q') = min{q, q'}. The scaling form C(t,t') = c*(h(t')/h(t)), where h(t) 
is some monotonically increasing function of t, holds for values of the correlation between contiguous fixed points. 
This shows that in the limit where the two times t, t! become large, the corresponding two-time plane can be divided 
into sectors, called T> Ul which we label by the index u. Each sector T> u is characterized by a monotonically increasing 
function of t, h u (t), and is defined by sending the two times t,t' to infinity with a fixed ratio A = h u (t')/h u (t). One 
then has C(t,t') — > a* (A). The various sectors have a hierarchical organization p8j in the sense that, if t,t' e T> u and 
t',t" eD», then i,t" eD m i n( „,„). 

So far this structure is just one way of expressing the long time limit of the function of two variables C(t,t'), in 
terms of a (possibly continuous) set of functions of one variable c* (A). It is a very general structure which relies only 
on weak ergodicity breaking. However this structure becomes much more interesting in view of the explicit solution 
of specific mean field models, which has shown that the fluctuation-dissipation ratio X(q) is constant in each domain 
V u , and correspondingly, 

Jrn^ TR(t,t')/^^-=X u , (32) 

independently of the value of A. This really implies a reduction of the number of variables, since it means that 
the integrated response is just proportional to the correlation in each domain. We will see that this hypothesis has 
far reaching consequences. We shall define the property of dynamical ultrametricity as the fact of having both the 
hierarchical domain organization, together with a constant fluctuation dissipation ratio within each domain. 

We shall now assume that we have a stochastically stable systems. Using our general strategy of linear response 
to random perturbations, we first argue that if it is dynamically ultrametric, then it is very likely to be ultrametric 
in the sense of the equilibrium distribution. We then relate dynamical ultrametricity to the property of separability, 
introduced in pq], which states that pairs of states with a given overlap q cannot be distinguished by the value of 
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any differently defined generalized overlap. For example we can define an "energy overlap" of two configurations as 
Q H (S, S') = (1/iV) J2 X h x (S)h x (S'), where h x (-) denotes the molecular field on site x corresponding to a given spin 
configuration. Separability means that, for any pair (a, 0) of pure phases, whose overlap q a p is equal to q, q H is a 
self-averaging quantity q H = f(q) that depends only on q. A trivial example of non-separable system, which is neither 
stochastically stable, is given by the union of two separable systems. Indeed it is clear that 

9 t H ot = qf + q? = f(qi) + /(<&) + f(n + «a), (33) 

as long as / is non-linear. Separability is therefore a strong requirement in the sense that it implies strong correlations 
among different parts of a system. 

We now generalize the static-dynamic equalities derived above to the three-point probability distribution function 
(<Zi2> 9i3j 923), relevant for the discussion of the ultrametric organization of pure phases. As in the previous case, 



we must identify a set of susceptibilities generated by this functional. Using the same construction as in section IV, 
let us divide the lattice in p = I + m + n slices and consider two perturbations of the kind 

H pH S ) = ^2 JxSxS T 1 ip> (x) S T^ p \x) " ' S T l { l ) m _ 1 (xy ( 34 ) 

and 



with two different realizations J x and J' x of the quenched couplings. Notice that H^p couples spins belonging to 

(2) 

the first I + m slices, while H p couples spins belonging to the last m + n slices. The total Hamiltonian is now 
H a > =H + eH { p 1] + e'H ( p 2) . We now evaluate the average of the observable 

°( S ) = zl JxJ' x SxS r w [x) ■ ■ ■ S t m (x) x S T c^ (x) ■ ■ ■ S T ( P j i{x y (36) 

where the spins in the first I slices are coupled with the spins of the last n slices. As in the case of the observables H p , 
useful expressions for the dynamic and the static averages of O are obtained by exploiting the self-averaging property 
and by integrating by parts over the variables J x and J' x . The calculations are lengthy, but conceptually similar to 
the ones relative to the observables H p . They are reported in Appendix |b|. We thus obtain the following expression 
of the static average: 

(O) = [3 2 ee'- (l - [ dq Pe(q)(q l+m + q l+n + q n+m ) 



P \ Jo 



2 J dq 12 dq 13 dq 23 Pj 3 > (q 12) q 13 , q 23 ) q^A^j ■ (37) 



Correspondingly, in off-equilibrium dynamics, we find the following expression of (0(f)) in terms of the time- 
dependent correlation and response functions: 



EjEj, (0(f)) = f3 2 ee'— [ dv I du 



P Jo 

x ([iCfavy-iRfav)] [C(v,u) m ] [nC{t,u) n - l R{t,u)] 
+ [iCfcvy-iRfttV)] [mCiv^uY^Riv.u)] [C(t,u) n ] 

+ [C(t, v) 1 ] [mC(u, w) m ~ 1 i?(w, «)] [nC(t, u)"- 1 ^, u)] ) . (38) 

We now exploit the ultrametric relation among fixed points of the application f(q,q') and the constancy of X(q) 
for values of q between contiguous fixed points that we discussed in section [n} We can thus express lim t ^oo (0(t)) as 
a functional of X e (q), namely 

lim EjEj, (0(f)) = 

t—±oo 

f ee >K (l- [dq \q l+m + q m+n + q n+l ] + f dq X Jq) q l+m+n 

P V J dq 1 J dq 

+ J dqi ^t 1 r dq2 ^ir [q[q2+n + qTq * +l + 9 "^ +m] ) ■ (39) 
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The derivation is given in Appendix |b| Since the observable O is local (in a suitably folded space) , it is reasonable 
to expect that it equilibrates, and thus that the long-time limit of (0(t)) is equal to its equilibrium expectation value. 
Notice however that O is not the energy density, so that its thermalization is not guaranteed by general principles: 
this is the reason why the link between dynamic and static ultrametricity, although very plausible, is not completely 
proved by our derivation. Assuming the equilibration of O, we obtain 



-P £ (3) (<?12, to, to) = ^Pe{qi2)x(q 12 )S(q 12 - to)%l2 - to) 

+ 7: [Pe(qu)Pe(qi3) %12 ~ to) %13 - to) 



permutations ] 



(40) 



This implies static ultrametricity with a weighting of the triangles as first found in 1 29 1 from replica theory. 

We shall now use again linear response to show that dynamical ultrametricity (and therefore, according to the 
above discussion, static ultrametricity) can be related to the property of "separability" defined in |2(J . 

In order to do so, let us introduce a different measure of overlap among states. Consider a system perturbed with 
the term H 2 (S) = z2x&S SxSt( x \- For this system wc introduce a new static overlap probability function by the 
usual procedure, discussed in sect. |lj. We introduce two copies of the system, and define a new overlap Q* between 
them by 

1 



Q*(S,S') 



7(2) (q Q' 



T(x) 



(41) 



The new overlap probability function P*(q*) is defined in complete analogy to (g) as the probability to find Q* = q*, 
at equilibrium. Correspondingly in dynamics one can define a new correlation function 



a new response function 



C *M') = Ji 2) (s x {t)s T(x) {t') + s x (t')s nx) (t)), 

"*<Sj»(*)> , S(S x (t)) 



xGSi 



Sh x (t<) Sh T(x) (t') 



(42) 



(43) 



and a new FDR X*(q*) according to the definition (||), with C and R substituted by C* and R*. C*(t,t') represents 
the average correlation of a spin at time t with (a part of) its molecular field at time t' . As the correlation induced 
by H 2 is positive, C*(t,t') should be, as C(t,t'), a monotonically decreasing function of the time separation. We can 
then define for long times, a function 

q*(q) = Jrn^ C*(t,t'), 

C(t,t') = q 

which is monotonic, with the exception at most of constant or vertical parts. These parts would represent a completely 
different evolution of C*(t,t') and C(t,t'), what seems to us a quite strange possibility. This suggests that in statics 
pairs of states with equal q also have equal q* . The algebraic expression of this property within the replica formalism 
has been discussed in ^6|. If we admit this property of separability, we have P*(q*) dq* = P{q) dq, and via stochastic 
stability X*(q*(q)) = X(q). Integrating by parts over J x as usual, we find the following expressions for C* and R*: 



R*(t,u) = Pe 



dsC(t,s)R(u,s)+R(t,s)C(u,s)+ / ds R(t, s) C(s,u) 



ds i?(i, s) R(s, u) 



(44) 



It is easy to check that in any correlation domain T> u where the correlation functions depend only on h u (t')/h u (t), 
the function C* depends on the same combinations of the time variables. If in addition we require that R*(t,t') = 
X(C) (dC*(t, t')/dt'), a detailed calculation shows that the only possibility is that X(q) is a constant in V u . 

We see then that if we assume the property of separability in statics, stochastic stability implies the existence of a 
unique dynamic function X{q) independent of the particular correlation and response function used in the definition. 
This would corroborate the interpretation of T/X(q) as a well-defined effective temperature for the system |Q. This 
conclusion depends on the validity of separability in the statics. Unfortunately, we have not been able to find a way 
to prove this property, although we feel that it should be possible to advance some arguments in favor of it, similar to 
the ones used above. The connection between separability and stochastic stability is an interesting point which needs 
to be clarified by further work. 
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VII. SUMMARY AND COMMENTS 



We have thus developed the linear response theory for glassy systems, based on the equilibration of the free energy 
density. The introduction of local random perturbations of the Hamiltonian, treated in linear response, naturally 
leads to a new equilibrium order parameter function P(q) and to a new fluctuation dissipation ratio X(q), which are 
obtained as the limits of the corresponding quantities when the perturbation gets small. From a theoretical point of 
view these two quantities possess appealing properties: 

• They are directly related by dX /dq — P(q). Thus the link between the static equilibrium order parameter and 
the out of equilibrium dynamics is clear, and P(q) can be measured by performing an off equilibrium dynamical 
measurement. 

• If the original Hamiltonian Hq has some quenched-in disorder, the static order parameter function P{q) is 
self-averaging with respect to this disorder. 

• The order parameter function P{q) is defined by the values of extensive, thermodynamic quantities. 

Therefore linear response allows to define a single, self averaging, order parameter function which is able to describe 
both the equilibrium properties and the off-equilibrium dynamics. 

If stochastic stability holds, i.e., if the average correlation functions are continuous with respect to small pertur- 
bations of the system, P(q) is equal to the overlap probability function P(q) of the unperturbed system, up to some 
simple effects of global symmetries which we have discussed. We have thus found the root of the formal identities 
between static and off-equilibrium dynamical quantities, often empirically found in the analysis of specific models. In 
general, if the system has a symmetry which is lifted by the perturbation, like a global Ising symmetry for a spin glass 
in zero field, then the new order parameter P(q) is equal to the usual overlap probability distribution in the presence 
of an infinitesimal breaking. 

The discussion has been extended to more complex characterization of the statistics of the equilibrium states. 
Stochastic stability allows to infer properties of the dynamics from properties of the statics and vice-versa. In this 
way we have argued, modulo some technical assumptions, that if static separability holds, i.e. if one can not define 
different notions of overlap yielding different predictions on the relation among the states, then dynamically the 
fluctuation dissipation ratio is a uniquely defined function independent on the particular correlation and response 
functions used in the definition. This suggests that ultrametricity should hold in all stochastically stable systems, 
both in the out of equilibrium dynamics and in the equilibrium properties. 

To conclude, let us stress the important experimental implications of this work. Whenever the values of the energy 
density can be considered close to their equilibrium, the order parameter function P(q) can be obtained from the 
determination of the function X(q) in an aging experiment. This requires separate measurements of the response 
and the fluctuation, which are in principle both accessible to experimental determination. Although generically valid 
for infinite time in short range systems, depending on the specific situation, the energy density equilibration can be 
fulfilled or fail on laboratory time scales. In structural glasses for example, the relaxation time for energy density is so 
large that one is never probing the time region to which our analysis apply. In spin glasses conversely it is generally 
believed that energy densities are asymptotically close to equilibrium. An experimental determination of X(q) in spin 
glasses would be therefore of the utmost interest, being equivalent to the determination of P(q). 
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APPENDIX A: 



We now derive the equalities ( |TT| ) and (O) . We start from the identity, valid for any set of Gaussian independent 
variables Jf^...,^ and for any function /(Jj: 



Ej[Ji u ...,iJ{J)] = Ej[Jl_ ip ]Ej 



dJV) 



(Al) 



Let us consider the canonical average of Hp R , 
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il<---<i p 

d 



T E * 



il<---<i p 



(Sn ■ ' ' Si p ) 



Pep 



T E Ej\l-(S h ...S ip f 



-N/3e (l - J dq P(q) q 1 



We obtain analogously in Langevin dynamics 

A 



(S n (t) ■ ■ ■ S lp (t)) 



ii<---<i p 

By considering the expression (||) of the Martin-Siggia-Rose action we obtain 



(A2) 



(A3) 



u <— <t 



Ae / dt' pC p - 1 {t,t')R{t,t l ) 



(A4) 



As stated in the text, equation (A4) holds in a much more general dynamical context. Consider a general relaxational 
dynamics in which spins are updated according to the local field, e.g., 



S x (t + St) = f(h x (t), Vx {t)), 



(A5) 



where h x {t) is the molecular field at time t (which depends on the other spins and on the quenched variables) and 
7] x (t) represents the thermal noise. S x (t) depends on Jj t j only through its implicit dependence on h x (t') at all 
previous times. Therefore, 



d 



EAJi,,...,^ (t) • • • S ip (t)) = Ej{J 2 ) Ej—^ (S H (*)••• S ip (t)) 



(A6) 



Now it is easy to see that 



= E hi* Si, (f ) • • ■ {S u (f )} • ■ • S 4p (0, 



(A7) 



where Si • • • {Si} • ■ ■ S p means that Si does not appear in the product. We thus find the relation (JA4) 



APPENDIX B: 

In this appendix we discuss the technical derivation of formulae (|37]) and ([38]), together with the the prove of ( |39| ) 
if dynamical ultrametricity holds. Although considerably more involved the derivations parallel the ones for the P(q) 
and X(q) without adding new physical insight. In order to simplify the exposition we introduce a multi-index notation 

i{x) = {x,T^{x),...,T^\{x)} ] 
j(x) = {Tf\x),...,l$ n _ l (x)y, 

k(x) = {T^l(x),...,T^\(x)}; (Bl) 
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and 



In these notations one has 





- S x S T ( P){x) . . . , S Tl l *l(x) 












X 


H m 


X 





= JxJ x Si(x)Sk(x)- 

X 



(B2) 

(B3) 
(B4) 
(B5) 



If we compute the average of O in statics we obtain 

d d 



EjEj,(0) = J2 EjEj,——(S i{x) S k(x) ) 



+ 2(Si(x)Sk(x))(Sj(x)Sk(x))(Si(x)Sj(x))) 



(B6) 



which, inserting the definition of P{q) and P^\q,q' ,q"), reduces to (|37|). 

In dynamics as well the derivation can be simplified by the use of a smart notation. The perturbations H\ and H2 
induce the following terms respectively in the dynamical action: 



pt l+m-l 



(B7) 



and 



J ° xtSt r=l 



iS T T M (u) ' 



(B8) 



Let us now define 



1-1 



r=0 
l+m-1 



iS 



J'(a0 



=1 
p-i 



(B9) 



With this notation the terms (B7) and (BE) are respectively written as 



du ^2 J x i&i( x )(u)Sj( x )(u) + i&j( x )(u)Si( x )(u) 



(BIO) 



Evaluating (0(t)) by integration by parts we obtain 
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(Q(t)) = ee' du dv (s^ x )(t)S k{x )(t) iSi( x )(u)Sj^ x )(u) + iSj( x )(u)Si( x )(u) 



x [iSj{x)(v)S k(x) (v) + iS k(x) (v)S j(x) (v) V 

Using the clustering property for far-away sites for small e, e', we get the relation 

(S i(x) (t)i$ i(x) (u)) = lC l -\t,u)R(t,u), 



(Bll) 



(B12) 



and analogous ones for the averages involving the multi- indices j(x) and k{x), which collected together give eq. (|3q 

Let us now sketch the derivation of eq. ( |39| ) from dynamical ultrametricity. Let us simplify the notations in eq. 
by writing, for r = l,m,n, 



C r (t,u) = C r (t,u); 

R r (t,u) = rC r ~ 1 (t,u)R(t,u). 



(B13) 



In this way eq. (|38|) reads: 

EjEj, (Oft)) = i y* 



/ [Ri(t,v)C m (v,u)R n (t,u) 
Jo 

+ Ci(t,v)R m (v,u)R n (t,u) + Ci(t,v)R m (u,v)R n (t, u)} . 



(B14) 



For long times we can write R r (t,u) ~ X e (C(t,u))d u C r (t,u), and the l.h.s. of eq. (|B14| ) becomes: 



P Jo 



du I dv[X t {C{t,v))d v Ci{t,v)C m {v,u)X f XC(t 1 u))d u C n (t 1 u) 

+ Ci(t, v)X e (C(u, v))d u C m (u, v)X e (C(t, u))d u R n (t, u)] + [n <-»■/] . 



(B15) 



The fact that X e (C) is constant within each crossover domain allows as to manipulate this equation as if the 
ultrametric relation among the correlation function were to hold for all time involved. This can be realized as the 
constancy of X e implies that in each domain one has to integrate a total derivative and the integrals can be performed 
explicitly. 

We now introduce the shorthand notations 



(dC(t, u)/du)du i — ► dC(t, u); 
nC n - 1 (t,u)dC(t,u)> — >dC n (t,u), 



(B16) 
(B17) 



and similarly for the other differential. Using this notation and the constancy of X e , we find that the first term of 
eq. (B15) can be written as 



dC n (t, u)X e {C{t,u)) 
while the second one is given by 



C(t,u) 



dCi(t,v) C m (t,v)X £ (C(t,v)), 



dC m (t,v)X e (C(t,v)) 



C(t,v) 



dC n (t,u) Ci(u,v)X £ (C(u,v)) + [m -M-n]. 



(B18) 



(B19) 



The extrema of integration refer to the variable C. Integrating by parts and collecting all terms we find eq. 
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